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Abstract 


'Fho study of Hortiiig Networks luis been iiitoreHting owing to its various ai)i)liciir 
tions aiul rich underlying theory. In this thesis, we try to analyze sorting networks 
coinbinatorially using a new method based on minimal sets. A non-trivial lower 
bound obtained through arguments based on minimal sets is also presented. 
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Chapter 1 
Introduction 


In tins, chapter, we give an informal introduction to comparison networks and sorting 
iietworLsy their representation, fundamental properties and applications. 


1.1 Comparison Networks and their Representa- 
tion 

In this thcwsis, we study sorting networks, which are special forms of comparison 
networks. A comparison network is comprised solely of wires and comparators. 
A comparator (Fig.l(a)) is a device which takes two real valued inputs, x and y 
and produce two output values x' and y' according to the rule: x' = min(x, y), 
y' = m&.x{x,y). 
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Figure 1: comparator 




I’ho compact representation of Fig.l{b) is often preferred and will be followed 
hereafter. A comparator thus sorts its two input values. We assume that a com- 
parator operates in 0(1) time. 

A wire transmits a value from place to place. A wire can connect the output of 
one comparator to the input of another. 

A comparison network is a set of comparators interconnected with wires. 

I'hroiighout this thesis, we assume that a comparison network contains n input 
wires through which the values < Xi,X 2 t..,Xn > to be processed by the network 
enter. The network also has n output lines in which the processed output val- 
ues < yj,y 2 .->yn > appear. We consider the input and the output as sequences 
< > and < yi,..,yn > respectively. Fig.2 shows a comparison network. 
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Figure 2: Comparison Network 

Wc draw a comparison network as a collection of n horizontal lines with the 
comparators stretched vertically. A line actually does not represent a single wire, 
but a seriuence of wires connecting various comparators. However, we follow the 
lH>pular torniinology and may use the term ‘line’ to indicate a wire when the meaning 
is evident from the context. Each comparator’s input is connected to a wire that is 
either one of the networks’ n input wires, or is connected to the output of another 
comparator. We consider only those networks which are not cyclic, ie., if we trace 
from the output of a given comparator to the input of another and so on, we shall 
never go through the same comparator twice. By convention, the network is drawn 
with inputs on the left and outputs on the right side. 



1.2 Functioning of Comparison Networks 


We assume tliat each comparator takes unit time for comparison, whereas, a wire can 
carry its input instantaneously from one end to another. Hence, if we trace any line, 
the t otal delay associated with the path traced is the number of comparators found 
in the line. Running time or delay of a comparison network is defined as the time 
it tak(\s for all output wires to receive their values, once all the input wires receive 
theirs. Here and always, we assume that the inputs are applied simultaneously. 
Informally speaking, this time is the largest number of comparators that any input 
clement can pass through as it travels from an input wire to an output wire. More 
formally, we define depth of a wire as follows. An input wire of a comparison network 
h<\s depth 0. Now, if a comparator has two input wires with depth dx and dy, then its 
output wires have depth max{dx, dy)+l. Since we do not allow cycles of comparators 
in any comparison network, the notion of depth becomes well defined, the depth 
or level of a comparator is defined as the depth of its output lines. The phrases 
like “comparators of the ith level” indicate the set of comparators in a comparison 
network having depth equal to i. 

The depth of a comparison network is the maximum depth of an output wire 
in the network. The comparison network of Fig.2 for example has depth 3. We 
also define size of a comparison network as the total number of comparators in the 

network. The network of Fig.2 has size four. 

Since a comparator is a passive clement in the sense that it can only transpose 
its two inputs and not transform the values, a comparison network, which is just an 
interconnection of comparators is equally incapable of transforming values. Hence, 
we have the important observation that the output sequence of a comparison 
network is a permutation of the input sequence. Actually, much more can be 
said about comparison networks in general. For instance, during the above discus- 
sion, we have assumed that the inputs to the network are real valued. However, the 
general results about comparison networks can be seen to hold for input sequences 
from any ordered set with total order < defined. This is owing to the intrinsic 
nature of the basic element, comparator, which is too weak for arithmetic and can 
only identify the relation <, and also due to the fact that our analysis (and interest) 



is fo(.uso(l only oil the ordering of elements at the output. Hence, we can as well 
considci secjiiences of integers (or from any ordered set) as inputs for the purpose of 
anal} sis. But the surprising fact that we can even do with much less, ie., with only 
input soiiuences from the set (0, 1}, with the normal partial order < can be seen 
from Bouriciu s theorem. This and some more fundamental results on comparison 
and sorting networks will be discussed in the next chapter. 

A comprehensive introduction into the subject can be seen in [1] where compar- 
ison networks are introduced in the context of the general problem of sorting. [2] 
also givt's a simple introduction. A more formal development of the above concepts, 
treating comparison networks as a subclass of the more general communication net- 
works can be seen in [3]. 

1.3 Sorting Networks 

A sorting network is a comparison network whose output sequence is monotonically 
increasing ie., yi < ya— < Vn for every input sequence. Sorting networks form an 
important subclass of comparison networks. 

Sorting networks are interesting because they afford an easy parallel hardware 
implenu'iitation. They also are interesting from a theoretical point of view since 
bounds on the complexity of several problems in general purpose communication 
networks, sorting, and boolean circuit complexity follow from the results on sorting 
networks, especially, from the celebrated Ajtai-Komlos-Szemeredi theorem [4], [5]. 
A brief account on the consequences of the AKS theorem can be seen in [3] which 
also presents a proof of the theorem. An account of the applications of sorting 
networks can be found in [8]. 

In this thesis, we will be centering our discussion on sorting networks, algorithms 
for their construction and complexity of the problem. In the next chapter, we 
develop some fundamental theory of sorting networks, some of which generalize to 
comparison networks. Also, a survey of the important problems and results are 
presented. This is followed by a cliapter that presents our work on sorting networks, 
conclusions from our work and discussions on further research. 



Chapter 2 

A survey on Sorting Networks 


This chapter is divided into three sections. In the first section, we shall look at 
some fundamental theorems on sorting networks. In the next section, we survey 
the developments in the problem of construction of efficient sorting networks and 
related siibproblems. In the last section, we discuss results on the complexity of the 
problem of building efficient sorting networks. 


2.1 Elementary Theory of Sorting Networks 

Information theory asserts that, to sort n items, we need at least Ign! compara- 
tors. Hence, an n input sorting network (which will be called an n-sorter hereafter) 
requires at least Ign! = nlgn — hlge — o(n) comparators. Since at a particular 
level (or depth) in a comparator network, we can have at most n/2 comparators, it 
follows that a depth of at least (nlgn-nlge — o(n))/(n/2) = 21gn-21ge — o(l) is 
required for an n input comparison network to become an n-sorter. We shall come 
across better bounds later in this chapter. 

It is (luite non-trivial to prove that a given n input comparison network is an n- 
sorter for arbitrary n. No general efficient procedure is- known. It would be sufficient 
to test with all n! permutations of the sequence < 1, 2, .., n > at the input. This fact 
follows from the observations we made in section 1.2. The following results show 
that in fact we can get by with far fewer tests. 



2.1.1 Bouriciu’s Theorem 


If f{x) is any monotonic function with f{x) < f{y) whenever x < y and if a given 
comparison network transforms the input sequence x =< X\,X 2 ,.;Xn > into the 
output sequence y =< yi,y 2 ,-,yn >, then the network will transform the input 
sequence fix) =< /(xi), /(a:„) > into /(y) =< /(yi), -./(yn) >• 

Proof: We use induction to prove that if any wire in a comparison network 
assumes value Xj when the input sequence < xi, ..,Xn > is applied, it assumes value 
f{xi) when input sequence f{x) =< /(xi),.., /(xn) > is applied. Since the output 
lines are also included in the statement, proving this proves Bouriciu’s theorem. 

For wires at depth 0, viz., the input wires, the result follows trivially. For 
induction, consider a wire at depth d, d>\. The wire is the output of a comparator 
at depth d and the input wires to this comparator are at a depth strictly less than 
d. By the inductive hypothesis, therefore, if the input wires to the comparator carry 
values .r, and Xj when input sequence x is applied, then they carry / (xi) and / (xj) 
when input sequence /(x) is applied. The output wires of this comparator then carry 
min(/(;ri),/(xj)) and max(/(xi),/(xj)) respectively. Now, since / is monotonically 
increavSing, for every i, j Xf < Xj implies /(xi) < /(xj). Consequently, we have the 
identities; 

nnn(/(xi),/(xj)) = /(min(xi,Xj)); max(/(xi),/(xj)) = /(max(xi,Xj)). 

Thus, the upper and lower output wires of the comparator at depth d must have 
values /(nnn(xi,xj)) and /(inin(xi, Xj)) respectively. Since they carry min(xi,Xj) 
and max(xi,xj) when input x is applied (this follows from the very definition of a 

comparator), the theorem is proved. Q.E.D 

Now if the comparison network is a sorting network, we have the following re- 
markable result 

2.1.2 Zero One Principle 

If a ain>parisoa network with n input lines sorts aU 2“ sequences from the set {0, 1}” 
correctly, then it sorts all sequences of arbitrary numbers correctly. 

Proof: Suppose tor the purpose of contradiction that the network sorts all zero- 
one s«nieucos, but there exists a sequence < > which the network does not 



sort, io., tliere exists some Xi, Xj such that i* < Xj, but the network places Xj before 
Xi in the output sequence. We define a monotonically increasing function, / as: 


1 otherwise 

Since the network places Xj before Xi, by the statement which we have proved 
to yield the Bouriciu’s theorem, the network places f{xj) before f{xi) in the output 
sequence when < /(xi,../(x„) > is the input sequence. But since f{xj) = 1 and 
f{xi) = 0, we obtain the contradiction that the network fails to sort the zero-one 
sequence < /{xi, ..,/(x„) > correctly. Hence, the theorem is proved. Q.E.D 


In our analysis of sorting networks, we use zero-one principle extensively and 
assume that inputs to the network are always zero-one sequences or vectors from 
(0, l}". By the above result it follow that results proved about sorting properties 
for such sequences will generalize for arbitrary input sequences from any ordered 


set. 


2.1.3 Non Standard Models 

Apart from the standard comparison networks seen so far, we also have non standard 
models which can have two types of comparators - one the standard one we have 
seen so far, and the non standard one which essentially functions in a similar way 
as the standard one, but with the output lines interchanged, ie., its top output 
line carrying the larger of the inputs and the bottom one carrying the smaller input. 
Since we need to differentiate between standard and non standard comparators, they 
are represented as shown in Figure 3. Figure 4 shows a non standard comparison 

network. 

Kuuth ([ll, exercise 16, p239) has shown that any non standard network can 
be transformed into a standard one without increasing its depth or size. He has 
also given an algorithm for such transformation. We shall not discuss non standard 
models any further and so, we will view comparators in the conventional way. 

In the next section, we shall survey the various methods for efficiently construct- 
ing sorting networks. 




Standard Comparator Non-standard comparator 


Figure 3: Standard and Non-Standard comparators 



Figure 4; Non-Standard Comparison Network 

2.2 Sorting Network Constructions 

First, we shall discuss the straight forward methods for constructing sorting net- 
works. This will be followed by a digression to discuss selection and merging net- 
works. Finally, we shall take up the AKS theorem and its consequences. 

2.2.1 Elementary Methods 

The most natural way of constructing a sorting network forn -1- 1 elements is to 
apply either the principle of insertion or the principle of selection on an n element 





sorting network and continue recursively. Figure 5(a) shows how the n+ 1*^ element 
can be inserted into a sorted set of n lines. Fig 5(b) shows how to select the largest 
in 71 + 1 lines and transfer it to the n + 1‘* line. 
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Figure 5: Making (n+l)-sorters from n-sorters 

It is interesting to see that both methods reduce to the same ’’triangular” 2n — 3 
delay procedure with 71(71 + l)/2 comparators. A 6-sorter constructed this way is 

shown below (Figure 6). 

However, it is natural to think of more efficient constructions of depth 0(log7i) 
and hence size 0(n log 7 ^) (the size bound occurring because at each level we can 
have at most n/2 comparators). This seems plausible in view of the information 

theoretic lower bound of 0(log7i) on depth. 

However, the problem turned out to be unexpectedly hard until* it was solved 





Figure 6: A 6-Sorter using insertion/selection 
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finally in 1983 by Ajtai, Komlos and Szemeredi (AKS). The rest of this section 
surveys the developments in the field leading to the celebrated AKS construction. 

To yield bounds better than the straight sorting methods described above, at- 
tempts wore made to divide and conquer the sorting problem with the help of merging 
and selection networks. 

An (rn, n)merging network (or (m,n)merger) takes, two sets of inputs, each of m 
and 71 lines respectively, has rn -t- n output lines and has the property that if each 
of the input sets is sorted, then the output also is sorted (Fig 7(b)). 

An {n, t)selection network (or (n, t)classifying network or (n, t)selector) is a net- 
work with n input lines and n output lines having the property that the t smallest 
inputs will be placed in the first t output lines (Fig 7(a)). Clearly, the definition is 
equivalent to saying that the n — t largest inputs will be placed in the n — t bottom 
lines. Hence, an (n, t)selector is also an (n, n — t)selector. 

From this point on, we use the following notational conventions. SminT', n) and 
T„i(r?i., n) will denote the size and depth respectively of an (m, 7^)merger and Si{m, n) 
and Ti{m,n) will denote those, of an (m, n)selector under consideration. Similarly, 
Ss(n) and Tj(n) will denote the corresponding parameters for an n-sorter. The 
suffixes shall be dropped when the meaning is clear from the context. 

Now, we can construct an n-sorter by merging the outputs from two n/2 sorters. 
Remembering the fact that a comparator is a (1, l)merger, the procedure can be 
applied recursively (Fig 8(b)). In a similar way, since a comparator is also a (2,l)se- 
lector, we can. use a (n,7i/2)selector followed by two recursive rz/2-sorters to produce 


t small inputs 


(a) (n,t) selector 



(n-t) large inputs 
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Figure 7; Schematic of Merge and Selection Networks 


an n-sorter (Fig 8(a)). In both the cases, we get the following recurrences for size 
and depth respectively: 


5,(71) = 25,(n/2) + 
r,(7i)=T,(n/2) + 


5m(n/2,n/2) for merge . 

Si{n,n/2) for selection 

Tm{n/2,n/2) for merge 

Ti[n,n/2) for selection 

This reduces the focus to efficient construction of merging and selection net- 
works, for, from the equation, it is clear that to produce O(logn) depth (and hence 
0(77 log 77 ) size) n-sorters, it would suffice to construct 0 ( 1 ) delay merge or selection 
networks. However, the following discussion shows that this unfortunately is not 
possible. 


1 1 






Figure 8: Sorting Networks using: (a)selection, (b)merge. 




2.2.2 Merge and Selection Networks 

K.E. Batcher in 1968 devised a parallel merge exchange sorting scheme [6] which 
could be applied to construct sorting networks as well to give O(log^n) sorting 
network. A generalized version of the same can also be seen in [l](pp 224-227). The 
( 71 , 7i) merger used here has size nlgn -I- 0(7i). Another merge-sort network based 
on bitonic sorting is described in [2], again taking O(log^ 77 ) delay. Several minor 
improvements were made in this network, but all (n, n)merging schemes yet required 
0 (log 7 i) time and thus gave O(log^n) sorting networks. 

Investigations for 0(1) delay (n, 7i)mergers were blocked when R.W. Floyd proved 
that Smiihu) > ^TilgTi -b 0(7i) (and hence Tm{n,n) > lg7i-+-0(l)) giving an el- 
egant simple proof ([l],pp 230-231). Later, A.C.Yao and F.F.Yao obtained tight 
lower bound for the merging problem [6] showing that SmiTn,n) > n(lg(7n-t- 1))/2. 
The paper also showed that Batcher’s parallel merge sort method was optimal and 
Floyd’s bound was tight up to a constant factor. 

V.E.Alekseyev had derived in 1969 ([l],p 234) an upper bound and a lower bound 
for ( 77 , t)selectors. He showed the upper bound Si{n,t) < (n - t)(2S'a(t)/f + 1), 
where Ss{t) is the number of comparators required for a t-sorter. He also de- 
rived a lower bound Si{n,t) > (n - t)lgrt + 1] using an ingenious proof. Later 
A.C.^’ao [7] improved the lower bound for t-selector showing that Ti{t,n) > Ign-f 

Ig ( l/(t lg[t -I- 1]) ( ] |. He also determined the asymptotic behavior of 

V V // 

Ti{n,t) as 71 00 to be IgTi-l- [IgiJ IglgTi-f O(logloglogn). 

Thus, we see that (ti, 7i/2)merger and (7i,n/2)selector, both require O(logn) 
depth and a recursive construction of 0(log7i) n-sorter using either of them is not 
possible. At the beginning of the 1980’s, it was generally believed that O(logn) 
delay n-sorter is an impossibility. Knuth actually went to the extent of presenting 
this open problem as “prove that the asymptotic value of S(ii) is not 0(n log n)” 
([1], problem 51, p 243). 

However, contradictory to the general belief, Ajtai, Komlos and Szemeredi (AKS) 
came up with a proof for existence of n-sorters of depth 0 (log n) (and size 0 (n log n) ) 
[4] [ 5 ]. Their proof is quite involved and uses properties of expander graphs. We will 



not expound the proof here. For the proof, we refer to Pipinger [3]. However, we 
shall look at the fundamental principles in the construction of the AKS network. 

2.2.3 The AKS Network 

The key discovery of AKS was the fact that although selection (or classification 
in the AKS terminology) is an f2(logn) delay problem, one could do approximate 
selection ox approximate classification in 0{l) time. An (n, t, e)approximate classifier 
(0 < e < 1) (or an (n, <) approximate classifier with tolerance c) is a network which 
takes n input values and has the property that for all 1 < x < t, at most ex 
of the X smallest elements are in the last n - t lines of the output and for all 
1 < X < 71— < at most ex of the x largest elements are in the first t lines of the output, 
informally, this means that an approximate classifier with tolerance e allows a small 
fraction e of error. In particular, when e = 0, an (7r,<, e) approximate classifier 
becomes an (n, t)selector. Now, Ajtai, Komlos and Szmeredi discovered that for all 
c > 0 there exists a constant c such that, for every n there is a network that is an 
(n, 7)./2, e)approximate classifier of depth c (and size at most cn/2). AKS gave an 
explicit construction for such networks using expanders. They then came up with 
a construction for an n-sorter using 0 (log 7a) stages of approximate classifiers, thus 
yielding 0(log7i) sorting network and thereby solving an important open problem. 

In the AKS network too, the sorting process proceeds recursively as in the case 
with the sorting networks based on (n, n/2)selectors. But since in this case we have 
a small error fraction, some sort of error correction mechanism is required. We can 
think of the sorting process as a binary tree. Initially all the “elements” to be sorted 
arc at the root (Fig.9). In 0(1) time, these elements are approximately classified 
and send to the child nodes Ni and N 2 and the process carries on. However, at each 
node the elements are further approximately classified (again in 0(1) time) and a 
few “large” elements from the left child and a few “small” elements from the right 
child arc send back to the parent. This is because the erroneous elements are present 
among these extreme elements with high probability. Thus, at each node we have 
two stages of processing. But this can only increase the delay by a constant factor 
since each stage is of delay only 0(1). 
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Figure 9: Operation of the AKS Network. 

The network operates almost uniformly in this manner from start to finish. At 
any time the number of elements at each node at a particular depth of the tree 
is the same and this number increases in a geometric progression with depth from 
the root. The upper smaller sized nodes are concerned with recycling that small 
fraction of the elements which may have been misclassified in some partitioning 
process. As the time progresses, the number of elements at each node is reduced 
again in geometric progression, thus squeezing the elements down the tree towards 
their final locations in the leaves. The correctness of the network is demonstrated by 
proving an invariant which bounds the number of “wrong” elements at each node. 
AKS showed that for a fixed constant c, this invariant reduces to a value less than 
unity at a depth of Ign — c of the tree. This means that, at this point each element 
is in its proper leaf of the tree and what remains is to sort the T- elements in each 
node, which in turn can be done in 0(1) time. Further, processing at different nodes 
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of the same depth are disjoint. Hence, each level of the tree require 0(1) processing 
time (jis each node require 0(1) time). Summing up, we see that to process up to 
a depth of Ign — c, one needs O(logn) time, and from then, complete sorting is 
achioved in another 0(1) time, thus, the total delay gets bounded by O(logn). 

Despite being O(logn), the AKS network unfortunately is of no practical value 
since the constants hidden in the Big-Oh notation axe enormous. Even with the 
improvements on the network suggested in [9] the delay is well over 6000 Ig n and 
for all practical purposes. Batcher’s network is much better. Further attempts to 
reduce the depth have come across very little success to this day. 

On the other hand, the huge gap between the information theoretic lower bound 
of 21g7i - 21ge - o(l) and the upper bound calls for improving the lower bound 
and reduce the disparity existing between the upper and lower bounds of the prob- 
lem. However, the discussion in the next session shows that even this seems to be 
unexpectedly hard. 


2.3 Lower Bounds 

We have already seen that information theoretically one need fl(lgn!) comparisons 
for sorting n items which yields a lower bound of nlgn — nlge on size and 21gn — 
21ge on depth. Simple improvements were made by Van Voorhis in 1972 who first 
derived a simple size bound of nlgn [11] and a late,r a more complicated bound 
of nig 71 + ^nlglgn -f Q{n) [12]. However, since then till 1980 no substantial 
improvements could be made on the depth bound while the size bound stayed for 
over 20 years. 

A.C Yao (1980) proved the following results which we state without proof ([8],The- 
orem 4.5, corollary 4.6, p 576). 

Theorem; Let a = l/(3(2 — lg3)). Then, for any fixed c > 0 there exists a 
number no such that for all n > no, 

T([7i“],n) > (3a-e)lgnRi (2.41-e)lgn. 

corollary; There exists a number % for every e > 0 such that r(i,n) > (Sa — 
e) lg7i w (2.41 — e) Ign for every n > no and n/2 >t> n“. 
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Since an n-sorter is an (n, <)selector for all 1 < f < n, it follows that the above 
boinul also applies to sorting networks, thereby yielding a lower bound of (2.41 - 
for depth for suflBciently large n. Observe that this result historically 
precedes AKS theorem. At that time, this bound was considered weak as it was 
generally believed that sorting is impossible in O(logn) time. 

However, after the discovery of AKS network, several attempts at reducing the 
size of the constants associated with the network failed. Then, efforts were directed 
towards improving Yao’s lower bound to reduce the mismatch between the upper and 
lower bounds. However, so far these efforts have met with little success. The only 
slight improvement so far was made by Nabil Kahale et al. [10] who proved a lower 
bound of (1.12 — o(l))nlgn on size and (3.27— o(l)) Ign on depth. The size bound is 
obtained by an interesting application of probabilistic method. They arrived at the 
size bound by counting the expected number of 0 — 1 comparisons (called collisions 
in their terminology) required when a random n-vector from {0, 1}" is given as input 
to an n-sorter. The depth bound is an improvement on Yao’s method. 

In this thesis, we look at sorting networks combinatorially using a new technique 
of analysis, although this yields no new results, it yields a better insight to the 
properties of comparison networks in general. Further, the approach used here 
might be applied to other similar problems as well. 
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Chapter 3 
Minimal Sets 


This chapter presents our work on sorting networks. Here, we develop an equivalent 
alternate formulation for the problem of sorting with a comparison network, based 
upon the idea of minimal sets which we shall see shortly. The zero-one principle is 
implicitly used in this formulation. In the first section of this chapter we introduce 
the concept of a minimal set and associated formalism. The next two sections 
explain their relevance to sorting networks. This shall be followed by a discussion of 
a lower bound obtained through arguments based on minimal sets. The last section 
presents the conclusions and scope for future work. 


3.1 Basic Techniques 

In this section, we introduce the notions of the string set associated with a wire and 
minimal string set associated with a wire in a comparison network. Later, we shall 
see a reformulation of the sorting problem based on them. Before formal definitions, 
we give here an informal introduction to the ideas involved. 

Consider an n-sorter with vectors < xi,X 2 ...x„ > and < yi,y 2 —yn > at input and 
output respectively. We have seen from the zero-one principle that it is sufficient to 
consider inputs from {0, 1}" alone to discuss sorting properties. Hence, we assume 
all Xi, Ui to belong to {0, 1}. 

For later notational convenience, hereafter, we reverse the numbering of the 



output lines of an n-sorter. i.e., the output wire will be assumed to carry the 
largest output ^ The revised numbering scheme is shown in Figure 10. Here, Xi 
and iji will denote values assumed by the input and output lines respectively of 
the n-sorter under consideration. 



Figure 10: Revised ordering of output lines of n-sorter 

We can think of the input vector x and the output vector y as strings from {0, 1}". 
Hence, hereafter, we shall denote them as strings from {0,1}” and write them in 
the form x — XiX 2 —Xn where each Xi € {0,1}. Observe that when x = xiX 2 —Xn 
is the input string to an n-sorter, the input wire assumes value 1 when Xi = 1, 
irrespective of the values of XjJ ^ i. The symbol shall be used to denote the 
string a; with Xi = 1 and xj = 0, jV i- Similarly will denote the string 

X = XiX 2 ...x„ with Xu = 1 if u € {i,i, and 0 otherwise. The strength or order 
of a string x denoted by jx] is defined as the number of ones in the string. A string 

of order i may be conveniently called an i-string. 

Now we can ask the question, what is the set of input strings for which the i 
input wire assume value 1. Evidently, there are 2”"^ such strings, since as long as 
the position has value 1, we can arbitrarily give any value from {0,1} to the 
remaining n - 1 positions of the input string, still keeping the value at the wire 
1 when the string is applied as input to the network. Here, it is convenient to think 

* Note that in the previous chapters we assumed that the output line carries the smallest 
output. 




of the string as the “minimal” string required to give value 1 to the input 
wiic (inininial in the sense having least order). It is quite convenient to work with 
such minimal strings. Hence the following formalism is developed. 

We introduce the partial order on strings from {0, 1}" as follows. For strings 
X = XiX 2 ...Xn and y = yiya-yn, we say x :< y if for 1 < i < n, x* < where 
< is the normal ‘less than or equal to’ relation between the numbers 0 and 1. If 
we say y ^ x. Note that the ordering is not total. Equality between strings 
is defined by x = y if x y and y x. We say x y if x and y are not equal. If 
neither x :<ynov y:<x we say x and y are incomparable, x A y shall stand for the 
string with the property (x A y)i = 1 if both Xi = 1 and yi = 1, while x V y shall 
denote the string with the property (x V y)i = 1 if either Xf = 1 or yi = 1. Clearly 
X A y X X V y, |x A yl < lx] < lx V y] etc. 

A set S of strings from {0, 1}” is said to form a minimal set if for any x,y E S 
neither x y nor y ::< x. i.e., if every pair of strings in S are incomparable. We can 
make any set S of strings minimal by removing from 5 all y 6 5 such that there 
exists some x € 5 satisfying the relation x ■;<y and x ^ y. The new minimal subset 
obtained from S shall be denoted by pi.{S). Clearly ij,{S) = 5 iff 5 is minimal. The 
following fundamental result shows that y(5) well defined. 

Theorem (Tl): The minimal subset /i(5) of a set S is unique. 

Proof: Suppose A' and Y be minimal subsets of S and let X ^Y. Then, there 
should be some element x in one of them, say X such that x € A and -'(x G Y). 
But X G 5. Hence, there must be some y eY such that y ■< x. But then, since 
y ^ X and y x we have -'(x G X) which is a contradiction. Q.E.D. 

As an example, consider the set S = {0101,1010,0111,0011} of strings from 
{0,1}'*. Here 0101 :< 0111 and 0011 ■< 0111, other strings being incomparable. 
Hence ti{S) = {0101,1010,0011}. 

If 5 is the set of all strings from {0, 1}” which when applied at the input of an 
n input comparison network, makes a particular wire I in the network assume value 
1, we say S is the string set associated with the wire I and niS), the minimal set 
associated with I or simply the minimal set of 1. The following observation follows 
directly from the definition of minimal set. 



Lemma (Ll): If 5 is the string set associated with a wire / in an n input comparison 
network and if for some particular input x G {0, 1}" / assumes value 1, then there 
must be some y € ii(S) such that y :<x. conversely, if x G {0, 1}” and if there exists 
a y € ii{S) such that y -< x, then I will assume value 1 when x is applied as input 
to the network. 

Informally, the lemma states that any input which makes the wire I assume value 
1 should have ones in positions corresponding to at least one of the strings in /x(5) 
and any input string that has ones in positions corresponding to at least one of the 
strings in n{S) will make wire I assume value 1. 

Clearly, the minimal set of the input wire is for 1 < i < n. We say 
a wire I is an i-string wire if the string with the lowest order in the minimal set of 
I has order i. The order of a minimal set is defined as the order of the string of 
minimal order in it. Thus, all the input wires to a comparison network are l-string 
wires and their corresponding minimal sets are of order 1. 

Lot N be an n-sorter. Then, the output wire of N will have value 1 if the 
input string to JV has order > i. In particular, we observe that the minimal set of 
i"* out put wire is the set of "C* elements containing all strings of order i. We put 
down these observations formally for easy later reference. 

Lemma (L2): 

(a) The string set associated with the input wire of an n-sorter W is {x € {0, 1}” : 
eh) x}. The minimal set of the input wire is {eh)}. 

(b) The string set associated with the output wire of an n-sorter is (y € {0, 1}'* : 
\y\ > i}- The corresponding minimal set is {y € (0, 1}” : \y\ = i}. 

Now, we shall move on to deduce the relation between the string sets associated 
with the input and output wires of a comparator. 

3.2 Strings and Comparators 

Consider a comparator C in an n-input comparison network with input wires a, b and 
output wires c, d, where c is the top output wire and d the bottom wire. Let Sa, Sb, Sc 
and Sd be the string sets associated with a, b, c and d respectively as shown in Figure 



11. Oui aim here is to find the relation between these sets and the corresponding 
minimal sets. The symbols defined above will be identically used throughout the 
remainder of this chapter with arbitrary comparators. 


Figure 11: Minimal Sets in a comparator 


The wire c will assume value 1 only if both a and b have value 1. Hence the 
strings associated with c are precisely the ones which are associated with both a and 
b. 1 . 0 ., Sc = SaO Si,. Similarly since d assumes value 1 when the values of either a 
or 6 is 1, we have Sd = SaU Si,. 

Now, consider the set 5^ = {x V y : x 6 fx{Sa) and y € niSt)}. Since x x V y 
and y xV y,it follows from LI that any string in S'c when applied as input to the 
comparison network shall cause both a and h and hence c assume value 1. Similarly 
any string from the set 5^ = {x : x G /i(5a) or x € y-iSb)} will cause the wire d to 
assume value 1. We summarize these observations into the following lemma. 
Lemma (L3); 

c S'c = S'a n iSj, 

(b)5;c5d = 5aU5b. 

Now, we shall prove the following non-trivial result. 

Theorem (T2): 

(a) ,i(s;) = ^(S,) 

(b) ,i(s;) = n(Si). 

The theorem permits calculation of the minimal sets of the output wires of a 
comparator directly from the minimal sets of its input wires. Before proving it, we 
need the following results. 

Lemma (L4): For any y € Sc, there exists some x G S'' such that x :< y. If y G Sd, 



then tliore exists some x e S'^ such that x :<y. 

Proof. Suppose y € Sc- Then, by L3, 1/ € 5a and y € Sb- Hence, by LI there exists 
Xi € /<(5a) and I 2 € ^{Sb) such that Xi y and X2 ^ y. Therefore xiV X2 ^ y. 
But (. 1.1 V X 2 ) € 5j. by definition. Similarly, if y € 5^, then there exists some x ^ y 
such that X € /i(5a) or x 6 /x(5(,). In either case x € 5^. Hence proved. 

Lemma (L5): 

(a) (i{Sc) C 5: 

(b) /x(5d) C 5 ; 

Proof: Let x 6 fJ-iSc)- Then, x 6 Sc- Hence by L4, there must be some y € 5c such 
that y :< x. However, by definition of y(5c), y x iff y = x. Hence, x € 5^. This 
proves (a). Proof for (b) is identical. 

Now we are ready to prove T2. 

Proof for T2: Using L5, we can write 5^ as the union of disjoint subsets y,{Sc) U C 
where C = S"^- /u( 5 c). If C is empty, ax{ 5 c) = iu( 5 c) trivially. Otherwise, let y €C. 
Since y € 5c (by L3), there must be some x € y{Sc) such that x y (by LI). Hence 
->{y € ft{Sc)) by definition of /x(5c). Thus, m ( 5 ^) = y-iSc)- This proves (a). Similarly 
(b) can be proved. Q.E.D. 

We shall denote y{Sc) as (j,{Sa)*y{Sb) and y{Sd) as ix{Sa)+y{Sb), defining ♦ and 
4- as binary operations on minimal string sets. We shall also use the terms *-wire 
and -h-wire to indicate the top and bottom output wires of a comparator. We say 
y € {0, 1}” are components of ^ 6 {0, 1}'* if z ^ x, z ^ y and z = x'^ y. Clearly 
every string in the minimal set of the *-wire of a comparator is either synthesized 
from a pair of component strings present in the minimal sets of the input wires of 
the comparator, or is itself present in the minimal set of one of the input wires. 

Let us look at an example to illustrate theorem T2. Let y{Sa) = {010,101}, 
y{Sb) = {110,001}. Then 5^ = {110,011,111,101} and 5^ = {010,101,110,001}. 
By T2, /t(5c) = /i(5;) = {110,101,011} and y{Sd) = /i(5i) = {010,001}. Here 
(001) € Sb and (010) € Sa are the components of (Oil) 6 y{Sc) and so on. 

Before concluding this section, we shall prove the following result which has 
important consequences. 

Lemma L6: If A'' and Y are minimal sets, then every x € A U F is an element of 



Z = (A- * Y) U (A + Y). 

riic lemma states that a minimal string associated with some wire at depth d of 
a comparison network will always be associated with some wire at depth d+1. i.e., 
a comparator cannot eliminate a minimal string from a comparison network. 

Proof: Let x € A. if there is no y ^ Y such that y then x is minimal in 
A U 1 . i.e., X € ix{X U y) or x € A" + V. Otherwise, if there exists some y £ Y 
such that y :< X, then xV y = x and hence xeS = {x\/y:xeX and y € Y}. 
Further, since x is minimal in A, there is no other x e X such that x ;< x. Also, 
for any x £ X, x :<x Wy for all y eY. Hence, for no x G A and y e 7 it can 
be the case that x V y :< x unless x = x and x Yy = x. In any case, x is minimal 
in S. i.e., x G ix{S) or x E X *Y. The case for x G Y is symmetrical. Thus in all 
cases ;r G (A' ♦ 7) U (A” + 7). Hence proved. 

The arguments followed in the proof for L6 shows that for all x G A and y € 7, 
if neither x :< y nor y :< x, then every string in A U 7 will be in A + 7. Further 
in this case, all strings in X * 7 will be different from the strings in both A and 7 
and X *Y will contain jA'llY] strings. Thus we have: 

Corollary Cl: If A" and 7 are minimal sets, the following conditions are equivalent. 

(a) For all x € A and y G 7 neither x :<y nor y x. 

(b) jA” * 7| = lAllYj. i.e., every x V y such that x G A and y G 7 is in A * 7. 

(c) |A + 71 = 1A| + 171 i.e., A U 7 = A + 7 

(d) A" U 7 and A * 7 are disjoint. 

Now, suppose if it happens so that for all x G A, x y for some y G 7, then 
A ♦ 7 = 7 and A + 7 = A. In that case the comparator performs no real function 
and we say that the comparator is redundant. In this case, we can directly connect 
the input wire whose minimal set is A to the bottom output wire and the other 
input wire to the top output wire, thus eliminating the comparator. It may seem at 
this st.age that such a shorting will lead to a cross connection of wires, and we will 
not be able to draw the comparison network containing the redundant comparator 
in the standard form after its removal. However, the discussion in [1] shows that 
even in this case we can redraw the network in the standard form without increasing 
the depth or size of the network. 



Since for all x,y € {0, 1}", |x| < |z V y|, equality holding only when xW y = x, 
we add the following observation to Cl. 

Corollary C2: The order of A' ♦ r will be > the order of both X and Y. Order of 
A ♦ 1 will be greater than that of both X and Y iff any of the conditions listed in 
Cl holds. 

With the theory developed so far, we shall try to look at some interesting prop- 
erties of sorting networks. 


3.3 Strings and Sorting Networks 

Several simple properties of sorting networks can be discovered using analysis with 
minimal sets. A sample result is given below. 

Proposition Pi: If N is an n-sorter of depth d, then any comparator at depth d 
should connect adjacent lines or it is redundant. 

Proof: Lot C be a comparator at depth d of N. We shall follow the notation 
used in the previous section to denote the wires connected to C and the string sets 
jU5sociat.od with them. Thus Sa,SbtSc and Sd will denote the string sets associated 
with the input wires a,b and output wires c,d of C. Let d and c be the z''* and 
output wires of N. Clearly j > i. By L2, n{Sd) = {x E {0, 1}” : [x] = i} is the 
set of all i-strings. Further, since fJL{Sd) = ii{Sa) + /J-iSb) every string x G lJi{Sd) 
should belong either to /i(5a) or to fi{Sb)- No x G n{Sd) can belong to both fi{Sa) 
and ^i{Sb) since in that case x G n{Sc) which is impossible since j ^ i. Thus, the 
i-strings in yi.{Sd) are disjointly distributed between /z(5a) and p(5(,). We have two 
possibilities. 

case 1: All i-strings belong to one of ju(5o),/x(S'(,). 
case 2: The i-strings are distributed between /i(5o) and fji,{Sb)*^- iUla a 1£549I 
If case 1, Let n{Sa) contain all i-strings. Then, every string in iJ,{Sb) must have 
order > i or else that string will appear in ti{Sd) which is impossible since /x(5d) 
has only i-striiigs. As c is the output line, Sb should contain all j-strings, since 
Sc = SaC] Sb- Further, no r-string x for j > r > i can occur in Sb as this will 
cause X to be in Sc since Sa also contain x (by L2,L3). Hence, iJ,{Sb) is the set of 
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all j-stiings. However, in that case, we can directly connect a to d and 6 to c and 
eliminate C. Thus, in case 1, the C becomes redundant. 

If c<ise 2, i.e., if the i-strings are disjointly partitioned between fJ>{Sa) and fjL{Sb), 
n{Sd) must contain some i + 1 strings. This follows from the fact that we cannot 
partition the set of all i-strings into non-empty subsets X and Y such that for all 
r: € A' and y € r ji V yj > i + 1.2 Thus, j < i + 1. But since j > i, it follows that 
j = i + 1. Hence, PI is proved. 

Now we proceed to study the characteristics of the minimal sets associated with 
the wires at different levels of an n-sorter. We start with the following fundamental 
result. 

Theorem T3: At a given depth d of a sorting network, a particular minimal string 
can be associated with at most one wire. 

We need the following result to prove T3. 

Lemma L7: If a minimal string x belongs to the minimal set of more than one 
wire at depth d of a comparison network, then x will belong to the minimal set of 
more than one wire at depth d + 1. 

Proof: Assume that a string x belongs to the minimal sets n{X) and /i(y) of wires 
xu\ and W2 at depth d, where X and Y are the string sets associated with wi and W2 
respectively. Suppose that wi is compared with W2 at depth d. Then, since x e X 
and X € y , X € A" U y and x e A n y. Further, since x is minimal to both A and 
Y, so should it be to A U y and Any. Hence, x e A + y and x G X *Y. Thus, 
more than one wire at depth d -f 1 has x in its minimal set. 

The lemma follows vacuously when wi and W2 are not connected to any comparator 
at depth d. Finally, L6 takes care of the case if either or both of them are compared 
with other wires at depth d. Hence proved. 

Proof for T3: L2(b) states that every string in {0, 1.}” is associated with exactly 
one output wire of an n-sorter. hence, if any string x were .minimal to more than 
one wire at any intermediate stage of an n-sorter, by L7, it should be associated 
with more than one wire at all subsequent stages including the output stage which 

^Tho statement is equivalent to saying that the set of all strings of order i cannot be partitioned 
into two non-empty sets X and Y such that the hamming distance between any pair of strings 
I 6 A' and y €Y is greater than two. 




is impossible. Q.E.D. 

As a corollary to this, we can modify L6 to the following form applicable to 
sorting networks. 

corollary (Theorem T4): If X and Y are minimal sets associated with the input 
wires of any comparator in a sorting network, then every re € X U F is an element 
of exactly one of either X + Y or A' * Y. 

In corollary Cl of L6, we have seen the conditions in which, if X and Y are 
the minimal sets of the inputs wires to a comparator, |A * F] = |A|.|F|. If the 
comparator belongs to a sorting network, T3 implies that A n F = 0. i.e., no 
x 6 {0, 1 }” can be an element of both X and F. Now, we shall study the case when 
lA * y’l < lAl-lFl. 

Let X € A and y e Y. In the proof L6, we have shown that if x < y, then 
(y = X V y) € A * F. Further, there can be no (y' y) € F such that y' X x as 
this would imply y' d y which is impossible. Hence x is minimal in A UF and thus 
X e X + Y. Also, it is clear that xVy = y only if x :< y. Hence, we have the 
following result. 

Lemma L8: Let A' and F be the minimal sets associated with the input wires of 
a comparator in a sorting network. The following conditions hold. 

(a) If X € A and y € F and x:<y, then y£X*Y andx€A+F. 

(b) If some y € F is also an element of A * F, then there must be some x € A such 

that X ■< y and x € A + F. 

Note that the case for y X x is symmetrical. 

We shall see one more result on the characteristics of strings in sorting networks. 
Theorem T5: Let x, y, x € {0, 1}” such that z = x V y with x and y incomparable. 
Also, let X, y, z belong to the minimal sets of some wires at depth d of an n-sorter. 
Then, for all depth i > d, if A*, F and Zi are the minimal sets containing x, y and 
z respectively in the network, then A^ F iff tii^re exists either some (y y) € F 

such that y' :<x ox some (x' # a;) € Xi such that x' :< y. 

Note that Xi^ Zi ^Yi bs otherwise z will not be minimal in the set to which 
it belongs to. The theorem puts considerable restriction over the distribution of 
strings in the minimal sets of various wires at each stage of a sorting network. 



To prove this result, we make use of the fact that introduction of an additional 
conii)ar<\tor between any two wires at any stage of a sorting network still yields a 
sorting network. 

Proof: For the purpose of contradiction, assume that Xi,Yi and Zi are the minimal 
sets associated with different wires wi,W 2 and W 3 at some depth i > d and for all 
;r € A’i,.y € Vi, neither x •< y nor y ■< x. Now, if we introduce a new comparator 
between wx and W 2 , then [z = xW y) e X *Y by corollary Cl of L6 and z will be 
associated with more than one wire at all subsequent stages of the network (by L7) 
which is impossible by T3. Q.E.D. 

To illustrate the effect of T5, consider the 2-string and are it’s 

uni(iue components and they are minimal elements of {{0, Hence, once 

e(«)0) is formed from and at all subsequent stages and will be in the 
minimal set of the same wire while will be in the minimal set of some other 
wire. 

Figure 12 shows the minimal sets associated with various wires of a 4-sorter. 
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Figure 12: Minimal sets in a 4-sorter 

T3,T4 and T5 depicts the essential features of minimal strings in a sorting net- 
work. We proceed now to apply the above facte to obtain a lower bound tor the 



sorting problem. However, we should note here that more intricate and interesting 
hidden properties might exist which could be revealed by a harder analysis. 

One consequence of our discussion so far in this chapter is that the problem of 
sorting using a comparison network can be translated into the problem of 
going from the set {e^} to {x 6 {0, 1}” : [xj = i} for all lines 1 < i < n in a 
comparison network, of course, under the constraints imposed by T3,T4 and T5. 

In particular, a lower bound obtained for the depth or size of a comparison 
network for the problem with strings will also be a lower bound for the 
sorting problem. The next section presents a result in this direction. As it turned 
out, the problem is hard to be analyzed with straight combinatorial methods that 
we Imve employed here. We present this result with the hope of setting a platform 
for lat er improvements using more profound mathematical tools for analysis. 

• 

3.4 A Lower Bound 

In this section we apply minimal sets to derive a simple lower bound for the size of 
an n-sortcr. For this, we introduce a classification of minimal strings as follows. 

• All 1-striugs belong to class 0. 

• All i-strings for 2^“^ < i < 2^ belong to class p for 1 < p < [Ign]. 

A wire is said to belong to class p if the string of lowest order in it’s minimal set 
belongs to class p. 

Evidently, a string of class p+1 can be formed only at the *-wire of a comparator, 
at lojust one of whose input wires carry a string of class p or p + 1. Hence, a wire 
of class p + 1 can be formed only at the *-wire of a comparator with at least one 
of whose inputs being a wire of class p or p + 1. Further, at the output stage of an 
n-sortor, wc have one class 0 line and class p lines for 1 < p < [IgnJ, with the 

remaining lines belonging to class flgn]. 

Fi-oin the discussion of minimal sets made in the preceding sections, we make 

the following observations. 



• Coniparison of two class-i wires at depth d result in a class-i wire and a wire 
holoiiging to either class-i or class-i + 1 wire at depth d -f 1. 

• Comparison of a class-i wire with a class-j wire, i < j, at depth d gives rise to 
a clnss-i wire along with a wire of class either j or j -t- 1 at depth d + 1. 

Now suppose at depth d of an n-sorter we have r class-i lines. Then each com- 
parator placed between two class-i lines will reduce the number of class-i lines at 
depth d -1- 1 at most by 1. In general, if we have r class-i lines in an n-sorter and if 
we want to reduce their number to t (t < r), we need t — t comparators and depth 
at least {r — t )/ (|) = 2(r — t)/n since at most n/2 comparators may be there at any 
depth of an n-sorter. 

We know tliat at the output stage of an n-sorter, there is one class-0 wire and 
exactly 2^“^ class-p wires for 1 < p < [IgnJ. We have also seen that a wire of class 
p + 1 cannot be formed without having a class p wire. These observations lead us 
to the following argument. 

Consider an n-sorter. At it’s input stage, there are n lines of class 0. To converge 
them to one line at the output, we need to use n - 1 comparators. In this process, 
we generate n — 1 class- 1 wires at different stages of the network. To converge them 
to one wire at the output, we need another n — 2 comparators yielding n — 2 class-2 
wires. In general, for all 1 < p < [Ignj, we will have n — class p lines and 
then use n — 2^ comparators to merge them to 2^~^ lines at the output. Hence, 
there should be at least — 2’) = u [IgnJ — 2l-'5”J -1-1 > n [IgnJ — n -f 1 

comparators in any sorting network. Further, this requires at least a depth of 
(71 [Ig 7 iJ - 71 -t- 1) / (n/2) = 2 [Ig nj - 2 H- 0{^). The last term will have the effect of 
increasing the depth by unity since depth and size values must be integral. Hence, 
we have 
Theorem T6: 

5 ( 71 ) > 71. l_lg 7iJ — n -1- 1 
T{n) > 2 Llg77.J - 1. 

The above results are weaker than the best known lower bounds in the literature, 
however, they are better than the ones obtained by information theoretic arguments. 



Note t hat by working with string classes, we have left out the effects of minimal 
strings within a class in increasing the depth and size of a sorting network. We 
have ilone this simplification because without it analysis becomes too complex to be 
tackled with direct combinatorial methods and we have not reached at a method to 
tackle the complexity of such an analysis. We hope research in future will come up 
with tools to solve this problem. 

We conclude this exposition with the following section which summarizes what 
we have seen so far and suggests aspects for future work. 


3.5 Suggestions for Future Work 

In the preceding sections of this chapter, we have seen some simple facts about 
sorting networks viewed in terms of minimal sets associated with it s wires. We 
have also seen a lower bound arising out of these facts. Also we have discussed 
possible improvements which could be carried out to yield stronger results. Further, 
most of the results we have seen here are about sorting networks and it will be 
interesting to investigate how much of them extend to general comparison networks. 

We hope that the approach used in studying sorting networks here shall be 
useful to handle several problems in general comparison networks, communication 
networks, switching circuits etc. The essential idea here is to associate with each 
wire in a network, the set of inputs which, when applied to the network gives the 
wire a particular value, and then study the properties of the whole network in terms 
of these sets. This approach should be useful in those cases where we are able to 
calculate the sets associated with the wires at later stages of the network from the 
known sets of the initial stages as in the case of comparison networks (Theorem T2). 
As it turns out, comparison networks form just one platform in which the idea finds 

a realization. 
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